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Packet 
Type 


Full Name 


Address Space 


Description 


Cacheabie 


I/O 


RTS 


ReadToShare 


Y 




Reauests read-onlv rnnv of r??rhp linp 

w M 10 ' <^ \J illy i^ujjy Ul liGOl IC 111 Iv? 


RTO 


ReadToOwn 


Y 




RpflllP^te writahlp rnn\/ nf rarho Hnca 


RTWB 


ReadToWriteBack 


Y 




r\cLjucaii tu leceive wniauie copy or cacne line 
and send cache line to memory 


RS 


ReadStream 


Y 




r\tjLjutsi)i ledu-unce copy ot cacne line 


WS 


WriteStream 

• 111 lw W LI V* til 1 I 


Y 




Request to write entire cache line and send to 
memory 


WB 


WriteBack 


Y 




Request to send cache line from ownina rlpvirp 

J ^ * W WWII W NJMWI iw ill 1 w 1 1 W III V*J 1 V 1 i 1 1 1 VJ t» V 1 

to memory, device does not keep copy 


WBS 


WriteBackShared 


Y 




Request to send cache line from owning device 
to memory, device keeps read-only copy 


RIO 


Read 10 




Y 


Request to read 10 locations 


WIO 


WritelO 




Y 


Request to write 10 locations 


INT 


Interrupt 






Sends an interrupt, target is specified by 
address 
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Transaction Type 


Initiator Receives 


Initiator Sends 


RTS 


DATA 




RTO 


DATA 




RTWB 


DATA & PRN 


DATA 


RS 


DATA 




WS 


ACK&PRN 


DATA 


WB 


PRN 


DATA or NACK 


WBS 


PRN 


DATA or NACK 



Fig. 8 



Transaction Type 


Initiator Receives 


Initiator Sends 


RIO 


DATA 




WIO 


PRN 


DATA 


INT 


PRN or NACK 


DATA or Nothing 



Fig. 9 



Access Rights Symbol 


Access Rights Name 


Description 


Data Present? 


w 


Write 


Read and Write 


Yes 


A 


All-Write 


Write-only, must write entire cache line 


Yes (orACK) 


R 


Read 


Read-only 


Yes 


T 


Transient-Read 


Readonly, read can be reordered 


Yes 


1 


Invalid 


No access rights 


Yes or No 



Fig. 10A 



Ownership Status Symbol 


Ownership Status Name 


Description 


Data Present? 


0 


Owner 


Owns cache line 


Yes or No 


N 


Not Owner 


Does not own cache line 


Yes or No 



Fig. 10B 



Access Right 


Ownership Status 


W 


O 


R 
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I 


o 


W 


N 


A 


N 


R 


N 


T 


N 


I 


N 
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Transaction Type 


New Owner 


RTS 


Previous Owner 


RTO 


Initiator 


RTWB 


Memory 


RS 


Previous Owner 


WS 


Memory 


WB 


Memory (or Previous Owner) 


WBS 


Memory (or Previous Owner) 



Fig. 11 
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Fig. 12A 



RTO 




Fig. 12B 
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Data and Address Queues 
720 



Promise 
Array 
904 



Transitory 

State 
Controller 
902 



Interface Controller 900 



Cache 
710 



State Info 
712 



Processing Unit 
702 
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Stacepescriptton ~~ ' ~ — j 


iwuth 


Waiting for WAIT and ACK for local WS. has wrice access and ownership " 


IWO 


jStable scate with wrice access and ownership 




.Waiting for WAIT and ACK for local WS. has read access and ownershio 


iROe 


jWaiung for DATA for local RTO. has read access and ownerships ~~ 


|K 


Ude 


Waiting for INV and DATA for local RTO. has read access and ownership 




jWaiting for INV for local RTO. has read access and ownership 


iROcb 


jWaiting for WAU ana DATA for local RTO. has read access and ownership 


IRQ 
ilOe 






Waiting for DATA for local RTO, has no access rights, has ownershio 


IlOde 


,Waiting for INV and DATA for local RTO. has no access rights, has ownership 


(iua jWaiting for INV far local RTO. has no access rights, has ownership ~ " 


{WIN) 


[Abie to send DATA/ N ACK ror local WB/WBS. has write access and no ownership " ' "" 


IWNi 


Able to send DATA for local RTWB. write access, no ownership 


WNh 


(Waiting for ACK for local WS, has write access, no ownership 


;WNc 


jWaiting for WAIT for local RTO. has write access, no ownership 


jWN 


jStable state with write access, no ownership (caused by foreign transaction thac took ownership, but for which no 
^opyback has yet been performed) 


|ANi 


{Able to send DATA for local WS after performing wrice co entire cache line, no ownership 


fRNj 


Abie co send DATA/NACK for local WB/WBS. has read access and no ownership 


!RNh 


Waiting for ACK for local WS. has read access, no ownership 


IRNg 


Waiting for INV for local WS. has read access, no ownership 


| 




iWaiting for DATA for local RTO, has read access, no ownership 


KNde 


sWaiting for INV and DATA for local RTO. has read access, no ownership 


;RNd 


•Waiting for INV for local RTO. has read access, no ownership 


! 


KINCB 


Waiting for WALT and DATA far local RTO. has read access, no ownership ~" 


- j 


RNcd 


jWaiting for WAIT and INV for local RTO. has read access, no ownership 


i 


RN 


Stable scate with read access, no ownership 




TN 


[Performing read(s). which may be reordered, far local RXS or RS. no ownership 




INk 


Waiting for local RTO. RTWB. WS, WB or WBS after receiving an ERR or ERRL. No access rights, no'ownershio 




INJ 


Able to send DATA/NACK for local WB/WBS. has no access rights and no ownership 




INh 


Waiting tor ACK for local WS or for DATA for local RTWB. has no access rights, no ownership 




INg 


(Waiting for INV for local WS or for INV for local RTWB. has no access rights, no ownership " ' ' 




INe 


Waidng for DATA for local RTO, has no access rights, no ownership 




INda 


jWaiting for INV and DATA far local RTO. has no access rights, no ownershio ' ' ' 




INd 


jWaiting for INV for local RTO. has no access rights, no ownership 




(INce 


Waiting for WAIT and DATA for local RTO. has no access rights, no ownership 




!1 Ned 


Waiting for WAIT and INV for local RTO. has no access righes. no ownership 




SlNa 


Waiting for DATA ror local RTS. DATA may grant read access, has no access righes. no ownership 




jlN 


iS table scate svith no access rights, no ownership — " 



Action 


i 
j 

Meaning ; 


Comments j • 




Commit to send an ACK packet as a 
copyback by appending an entry for the 
received foreign packet in a copyback list. 
Set codvlsg to 1. 


ACK packet may be sent from any state that aiiows j 
copyback packets to be sent. It must be sent within a ! 
finite time of first entering such a state, regardless of 
what other oackets have been received. 


a 


Ccmmit to sena DA \ A. anc/or ACK packets 
for all outstanding copybacks for this cache 
iine. Next, set copy tag to W. Then, perform 
state transition based on current state & 
local packet being received. 


It sending copybacks changes the state from a state 
X to a state Y, the local packet being received will be 
received in state Y (and as a result, the entry for 
state Y in the table must be consulted to determine 
the state transition caused by receiving the local 
oscket). 


16 i 

j 
i 


Commit to send DATA packet for local 
RTWB, WS, WE, or WES transaction. DATA 
packet is sent in response to receiving a 
FRN packet for this transaction. 


DATA packet may not be sent until a PRN packet is 
received. It must be sent within finite time of 
receiving the PRN packet & having entered a state 
that permits the packet to be sent, regardless of what 
other packets have been received. 


el 


Clear outstanding copyback commitments 
for this line by removing them from the 
copyback list Do not send DATA or ACK 
packets for entries thai were on the 
copyback list. Next, perform state transition 
based on currant state & local packet being 
received. 


i his action code is used in response to receiving an 
ERR or ERRL packet if an ERR packet was 
received in place of a PR or PRACK packet, or if an 
ERRL packet was received in place of a DATAF 
packet, a DATA packet may be sent to the error 
device. 


l\ 


Commit to send a DA i A packet as a 
copyback by appending an entry for the 
received foreign packet in the copyback list 
Setcoov tsa to 1. 


DA i A packet may be sent from any state that allows 
copyback packets to be sent. It must be sent within 
finite time of first entering such a state, regardless of 
what other packets have been received. 


l\ 


aet write tag to 1. j 


/n 


commit to send NACK packet for locai WB 
or WES transaction & set write tag to W. 
NACK packer is sent in response to 
receiving a PRN packet for this transaction. 


NACK packet may be sent at any time after receiving 
the PRN packet. It must be sent within finite time of 
receiving the PRN packet, regardless of what other 
packets have been received. 


/r 


Ccmmit to send a DATA packet as a 
copyback by appending an entry for the 

j received foreign packet in the copyback list. 

! If copy tag is W, set cooy taa to R. 


DATA packet may be sent from any state that aiiows 
copyback packets to be sent. It must be sent within 
finite time of first entering such a state, regardless of 
what other oackets have been received, 


is 


S bet write tag to R. 


! 


/w 


j Commit to send a DA t A packei as a 
1 copyback by appending an entry for the 

| received foreign packet in the copyback list 

j 
t 


DA l A packet may be sent from any state thai allows 
copyback packets to be sent It must be sent within 
finite time of first entering such a state, regardless of 
! what ether packets have been received. 


/y 


j it copy tag is R, set copy tag to 1. 


Used to record invalidating transactions while a 
ccoyback for a torsion memcrv remao is pendina 


/z 


It write tag ss R, set write tag to i. 


Used to record invalidating transactions while a iccai 
WES transaction is oencino. 
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ti 



Memory 
Subsystem 
144BA 
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Subsystem 
146A 
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Processing 
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Data Network 
152B 
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Address Network 
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Processing 
Subsystem 
142AC 



TT 



Processing 
Subsystem 
142BC 



Memory 
Subsystem 
144AC 



Memory 
Subsystem 
144BC 



Data Network 
152C 



Fig. 20 



gTag 


Description 


gM 


The maximum access right within the node is Write Access 


gs 


The maximum access right within the node is Read Access. No 
client device in the node can have Write Access. 


gi 


The maximum access right within the node is Invalid Access. No 
client device in the node can have Read or Write Access. 



Fig. 21 



Packet 




Address Space 




Type 


rull Name 


Cacheable 


I/O 


Description 


FRT3 


Proxy RTS 


Y 




Request from an interface in a gS or gl node in 
response to an RTS request from another nGde 


PRTSM 


Proxy RTS Modified 


Y 




Request from an interface in a gM node in 
response to an RTS request from another node 


PRTOM 


Proxy RTO Modified 


Y 




Request from an interface in a gM node in 
response to an RTO request from another node 


PRTO 


Proxy ReadToOwn 


Y 




Request from an interface in response to an RTO 
reqest from another node 


PU 


Proxy Upgrade 


Y 




Request from an interface asking memory to 
supply data for an outstanding RTO 


PDU 


ProxyDataUpgrade 


Y 




Request from an interface asking memory to 
update gTag to gM; interface supplies data for an 
outstanding RTO 


PRSM 


Proxy ReadSiream 
Modified 


Y 




Request from an interface in a gM node in 
response to RS request from another node 


PIM 


Proxyinvalidate 
Modified 


Y 




Request from an interface in a gM node to 
invalidate data in caches and memory 


PI 


Proxyinvalidate 


Y 




Request from an interface in a gS or gl node to 
invalidate data in caches and memory 


PMR 


ProxyMemoryRead 


Y 




Request from an interface to memory to read 
coherency state(s) and data or meta-data 


PMW 


ProxyMemaryWrite 


Y 




Request from an interface to memory to write 
coherency state(s) and data or meta-data 



Fig. 22 



Packet 
Type 


Full Name 


Description 


DATAM 


Data-Meta 


Data packet containing data and coherence state information 


DATAN 


Data-NoPull 


Data packet sent in response to PRTSM indicating no PRN will be 
coming 


REP 


Report 


Report from memory to an interface indicating a transaction to be 
handled by the interface 



Fig. 23 



Subtransaction 


Preexisting 

Global Access State 


New Global Access State 


PRTSM ! 


Modified 


Shared 


PRTOM 


Modified 


Invalid 


PRTO 


Shared, Invalid 


Invalid 


PU 


Shared 


Modified 


PDU 


Shared, Invalid, Modified 


Modified 


PRSM 


Modified 


Unchanged 


PIM 


Modified 


Invalid 


PI 


Shared, invalid 


Invalid 


PMR 


Shared, Invalid, Modified 


Unchanged 


PMW 


Shared, Invalid, Modified 


Equal to new global access state 
specified in DATAM packet ! 
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Home Node 140H 




Requesting Node 140R 
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Home Node 140H 
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Home Node 140H 
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Data Out 
k 



830 



r 



840 



Data In 



Address In 



820A 



820B 



Bus Agent 
810 



Queue 
814 



Address Out 



820C 



820D 



Request Agent(s) 
802 



Home Agent(s) 
804 



Global Information 
850 



. Slave Agent(s) 
806 



Interface 148 



Communications In/Out 



Fig. 29 



Home Node 140H 
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Home Node 140H 



PRTO 




Acknowledgment 





f Interface Y/ 


RTO 


*K 148R J 


V D1 ' N J 


-^DATA 




Requesting Node 140R 
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r 



Response Info 


gTag 


Home Memory Subsystem Action 


No 


gM 


8C Mode- Allow owning device to respond. 
PTP Mode- Forward response to owning 
device 


No 


gs 


Send REP packet to interface if write access 
requested 


No 


gi 


Send REP packet to interface 


Yes 


gM 


Respond with copy of the requested coherency 
unit 



Fig. 35 



Response 
Info 


Memory Subsystem's Action 


mN 


Does not respond with copy of 
coherency unit because a cache within 
the node owns the coherency unit 


mR 


Does respond because memory is the 
owner 


mS 


Does respond to requests for shared 
access because memoiy has shared 
copy and no active device has 
ownership; does not respond to 
requests for write access 


ml 


Does not respond because memory's 
copy is invalid 



Fig. 36 




Requesting/Home Node 140H 



Fig. 37 



Send PRTOM, PRTSM, 
PIM, or PRSM specifying 
the coherency unit 
500 



T 



Respond = false 
502 



I 



Current record = oldest 
record in OTQ specifying 
the coherency unit 
504 



Yes 



Respond = 

False: Receive data packet 
from active device in 
response to packet sent at 
500. Send received data in 
coherency message 

True: Send data from buffer 
in coherency message 

512 



Current 
record correspond to packef 
sent at 500? 
506 



No 



Fig. 37 A 



Current record = 

RTO: Send data packet using data from 
buffer if respond = true & set respond = 
false 

RS, RTS: Send data packet using data 
from buffer if respond = true 

WB.WBS: Send PRN packet. Set 
respond = true if responsive DATA 
packet received & store received data in 
buffer 

WS, RTWB: If respond = false, send 
PRN & set respond = true & store 
received data in buffer. If respond = true, 
send PRACKorDATAP 

508 



T 



Current record = next oldest record in 
OTQ specifying the coherency unit 
510 



Requesting/Home Node 140H 




Slave Node 140S 
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Packet 
Type 


Full Name 


Description 


RWB 


Remote WB 


Request sent from an active device in a multi- 
node system to an interface in order to initiate a 
WB transaction 


RWBS 


Remote WBS 


Request sent from an active device in a multi- 
node system to an interface in order to initiate a 
WBS transaction 


RWS 


Remote WS 


Request sent from an active device in a multi- 
node system to an interface in order to initiate a 
WS transaction 
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Requesting Node 140R 
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